Thomas A. Kersten 
Marla S. Israel 


Planning and Changing 
Vol. 36, No. 1&2, 2005, pp. 47-67 


TEACHER EVALUATION: PRINCIPALS’ INSIGHTS AND 
SUGGESTIONS FOR IMPROVEMENT 

Introduction 

In the twenty-first century, school improvement is the focal point 
for educational leadership. Improvement must take the form of higher stu- 
dent achievement test scores, an engaging classroom that meets the needs 
of all learners, and a more meaningful learning environment for teachers 
and students. In the twenty-first century, the school building administrator 
is recognized as the catalyst for this necessary improvement. The school 
building administrator is no longer viewed as a manager, though s/he still 
has managerial roles. Rather the principal must be the instructional leader 
(Glickman, Gordon, & Ross-Gordon, 2003; Sergiovanni, 1994). 

Within the area of teacher evaluation, the evaluation tools, along 
with the amount of time, format, and feedback, have changed dramatical- 
ly from the past procedures used by the principal as manager (Danielson 
& McGreal, 2000; Schmoker, 2001). Two drop-in visits with a pre-made 
checklist are no longer considered acceptable practice (DeMoulin, 1988; 
Edmonds, 1981). The literature now considers the use of pre- and post- 
observation conferencing, narratives, rubrics, and portfolios as best prac- 
tice procedures within teacher evaluation, with the result being school 
improvement (Danielson, 2002; Darling-Hammond, 1997; Kerrins & 
Cushing, 2000; Klein, 1990; Tucker & Strong, 2001). But do these prac- 
tices really deliver? Is the time that is necessary to conduct these measures 
reasonable? Can one building principal do justice to these measures for all 
of their teaching staff? Do principals feel that the time and effort result in 
increased student learning? Are there still barriers to improving teaching 
and learning within the teacher evaluation process? Do principals believe 
that there is a better way to improve teaching and learning? These are the 
questions that motivated this study. 

Literature Review 

The demands for improving the quality of teaching and learning 
in public schools are as strong today as they were when the Soviet Union 
first launched Sputnik in 1957 or A Nation at Risk was published in 1983. 
Public school administrators and, in particular, school principals typically 
feel tremendous internal and external pressure to improve the quality of 
teaching in their schools in an effort to increase student achievement 
(Connors, 2000; Edmonds, 1981; Green, 2001; Schmoker, 2001). Internal 
pressure may result from the passion that many administrators bring to 
their positions or from the accountability demands built into collective 
bargaining agreements and/or state laws which can limit an administra- 
tor’s authority within the evaluation process (Bolman & Deal, 2003; Mar- 
czely & Marczely, 2002; Murphy, 2002). 

External pressure often emanates from a variety of sources 
including national and state-level politics, high profile business leaders. 
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and even local school district stakeholders who are not shy about voicing 
their concerns about the perceived lack of student achievement in public 
schools (Green, 2001; Senge, et ah, 2000). In the last few years, this 
external pressure has been further exacerbated by the passage of the No 
Child Left Behind Act which imposes mandated sanctions for schools that 
do not meet increasing student achievement standards primarily related to 
standardized achievement tests (Illinois State Board of Education, 2004). 

Research in educational leadership convincingly demonstrates 
that building level administrators are the central figures in the school 
improvement process (Murphy, 2002). Studies have consistendy linked 
substantive student achievement gains to what happens at both the indi- 
vidual school and more specifically the classroom level (Danielson & 
McGreal, 2000; Fullan, 2001; Heller, 2004; Stigler, 1999). Since princi- 
pals and assistant principals are directly responsible for faculty supervi- 
sion, including teacher evaluation, it is not surprising that building 
administrators often find themselves held accountable for school 
improvement efforts and ultimately student achievement gains. 

Within the Spumik years, when schools were seen as needing to 
be improved, curriculum was the focus for fixing. A factory model was 
assumed within curriculum development resulting in programmed readers 
and independent learning modules in math and science. These were creat- 
ed by educational publishing companies whose “teams of experts” certi- 
fied a consistent message and, therefore, a constant quality product — the 
child. These curricula were considered “fool-proof,” with the fool being 
considered the adults in the school. In dispensing this material, a good 
teacher was one who demonstrated certain traits: voice, appearance, accu- 
racy, enthusiasm, and warmth, making certain that the children moved 
through the curriculum (Meux, 1974). The authors remember as children 
themselves moving from aqua to silver to gold in the reading series, with 
this color progression indicating that we were successful students who had 
learned the required curriculum. Therefore, the building principal, as 
manager, was to ensure that children progressed from one level to the next 
and that teachers were keeping accurate records of this progress and 
exhibiting the appropriate traits to foster it. 

Moving from the 1960s into the ’70s and ’80s, the research focus 
shifted from programmed curriculum and teacher traits to an examination 
of necessary teacher skills and then to the Madeline Hunter model of 
teaching. Rather than prescribed curriculum, a prescribed delivery model 
was now seen as the road to school improvement. The building leader was 
to evaluate the teacher’s performance against the prescribed teaching 
model. Principals were armed with checklists to verify that a participatory 
set, a mini-lesson, and guided practice were provided (Hunter, 1982). 
Cooperative learning, with its structures, was also seen as a way to 
improve student learning (Slavin, 1994). Again, the building principal was 
armed with a checklist to note simultaneous interdependence, student 
roles, and individual productivity. Throughout the late ’60s, ’70s and early 
’80s, the principal was busy checking off discrete items within a cook- 
book of school improvement. Professional development provided by both 
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the teacher unions and the administration focused upon the performance 
of these discrete measures. Teacher unions trusted these quantifiable 
checklists, since they rendered teaching and learning into black and white 
indices. Subsequently, teacher evaluation focused solely on these objec- 
tive measures and it became the duty of the administrator to prove when 
the teacher did not demonstrate them (DeMoulin, 1988; Popham, 1992; 
Marczely & Marczely, 2002). 

As the 1980s closed with the beginning of brain research, a more 
complex picture of teaching and learning began to emerge. From the late 
1980s, through the ’90s and now in the twenty-first century, ideas con- 
cerning teaching for understanding, authentic pedagogy, backwards 
design of curriculum, and the standards-based movement dominate the 
discussion of what is teaching and learning (Brophy, 1992; Haefele, 1993; 
Wiggins & McTighe, 1998). A mere checklist cannot capture the nuances 
of this new view of the teaching and learning process. This new conceptu- 
al model requires depth of understanding with multiple measures of aca- 
demic and teaching performance. These multiple measures of teaching 
performance speak to the need for a more complex teacher evaluation 
model (Danielson, 2002; Rebore, 2000; Seyfarth, 2001). Additionally, the 
literature supports the belief of many stakeholders that improving the 
teacher evaluation processes will lead to instructional improvement and 
ultimately student achievement gains (Senge, et al., 2000; Tucker & 
Strong, 2001). Thus, a teaching evaluation model has emerged that is 
more detailed and takes more time and effort for both the teacher and the 
building administrator. 

This shift in the research attracted the attention of state legisla- 
tures, many of which have passed legislation increasing teacher evalua- 
tion requirements and mandating teacher evaluation training for certified 
administrators. For example, in Illinois statewide legislated reform initia- 
tives in the mid-eighties required school districts to develop specific 
teacher evaluation plans, including prescribed components, which were 
then submitted to the Illinois State Board of Education (ISBE) for 
approval. This legislation subsequently mandated that all administrators 
who evaluate teachers participate in a common state-approved multi-day 
workshop on teacher evaluation (ISBE, 1985, 1988, 2003). It was later 
amended to include annual, mandatory administrator attendance at state- 
approved workshops linked to school improvement — often focused on 
teacher evaluation (ISBE, 1995, 2001). 

With these legislative changes, educators have watched teacher 
evaluation processes evolve from simple end of the year checklists or 
summative narratives to more sophisticated clinical processes and reflec- 
tive teacher evaluation models (Danielson, 2002; Heller, 2004; Peterson, 
Wahlquist, Bone, Thompson, & Chatterton, 2001). Simultaneously, build- 
ing-level administrators have experienced a dramatic increase in both the 
amount of time and skill required to implement these teacher evaluation 
processes while balancing the ever-increasing daily demands of adminis- 
tration (ISBE, 2002). Within this context of increased responsibilities and 
accountability several important concerns related to teacher evaluation. 
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school improvement, and increased student achievement remain unan- 
swered. This research study seeks to explore these issues through the eyes 
of Illinois building-level school administrators who serve in the northern 
Cook County suburbs. While the research questions posed are asked from 
a broad perspective, the data are from a limited sample. Thus, generaliza- 
tion of the data to the entire state of Illinois or to the profession as a whole 
is subject to the interpretation of the researchers and the reader. 

Problems and Purpose 

As the emphasis on teacher evaluation has increased, so have both 
the number and variations of teacher evaluation models. In addition to the 
traditional summative evaluation that is characterized by checklists and/or 
narratives built around discrete performance indicators, the most promi- 
nent models are personal and instruction goal setting, clinical observation 
processes, portfolio assessment, and self-evaluation (Danielson, 2001; 
Kerrins & Cushing, 2000; Sawyer, 2001). Given the plethora of approach- 
es, two significant questions are: Which teacher evaluation approaches are 
most widely employed in K-8 public education today? Do school districts 
employ the same or different teacher evaluation approaches with their 
tenured and non-tenured faculty? 

In addition to identifying the types of teacher evaluation instru- 
ments employed, their effectiveness in improving teaching and learning is 
also an important consideration particularly since school-level administra- 
tors could potentially spend a great deal of their time completing the 
required teacher evaluation process (McGrath, 2000). As first line evalu- 
ators charged with improving the quality of teaching and student learning 
in their schools, these building-level administrators can provide valuable 
insights into the effectiveness of teacher evaluation as a tool. As such, 
their judgments about the impact of the various approaches to teacher 
evaluation are important in understanding more thoroughly the school 
improvement process (Wilkerson, Mannatt, Rogers, & Maughan, 2000). 
Therefore, this study seeks to understand the following: Do school build- 
ing administrators perceive certain evaluation approaches to be more 
effective than others? 

As the expectations for evaluating teachers have increased and the 
models employed expanded and become more sophisticated, administra- 
tors are expected to make teacher evaluation a priority (DeMoulin, 1988). 
Given the complexity of building-level administrators’ responsibilities 
and the ever increasing demands on their time, this study asks: How much 
time do administrators spend completing all elements of their school dis- 
trict evaluation process with non-tenured and tenured faculty? 

Additionally, teacher evaluation systems are continually evolving 
and increasing in importance within the teaching/achievement debate 
(Popham, 1992; Tucker & Strong, 2001). In practice, the present approach- 
es to teacher evaluation may or may not be judged by school a d ministrators 
to have positive impacts on teaching and learning. However, the process of 
teacher evaluation itself may yield other necessary benefits beyond the 
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improvement of teaching and learning emphasis. Simultaneously, because 
building administrators are intimately knowledgeable about their district- 
required teacher evaluation systems, they are in the unique position to iden- 
tify specific policies, practices, and beliefs which inhibit optimal teacher 
evaluation effectiveness. Therefore this study seeks to investigate the fol- 
lowing: What do building administrators perceive as benefits associated 
with teacher evaluation? What impediments do building-level administra- 
tors identify which may limit the effectiveness of the teacher evaluation sys- 
tem in their schools? 

Finally, as principals and assistant principals go about their daily 
work as educational leaders, they have a unique understanding of most 
aspects of their individual school program and culture (Murphy, 2002). 
Because they work with faculty and students, provide leadership in cur- 
riculum and staff development, and interact with a multitude of internal 
and external stakeholders, administrators have the potential to understand 
what strategies might make a difference in improving teaching and stu- 
dent achievement (Senge, et ak, 2000; Sergiovanni, 1994). These insights 
honed on years of teaching and a d ministrative experience could prove 
very valuable in the improvement process (Glickman, et ak, 2003). There- 
fore, this study seeks to understand administrative reflections pertaining 
to the following question: What do building administrators believe are the 
most valuable tools to improve teaching and student learning? 

The Research Study 


Context 


Illinois is a state of contrasts. From the southern-most small town 
of Cairo to the northern metropolis of Chicago, Illinois is a state com- 
prised of both cornfields and big cities. It is also “a state renowned for its 
legacy of local control of its public school districts” (Shanahan, 1988, p. 
4). About 2,044,540 students are enrolled in 3,907 public schools in 887 
districts within 110 counties grouped into six regions of the state (ISBE, 
2004). According to the Illinois 2003-2004 State Report Card, these 
2,044,540 children are 58.6% white, 20.7% black, 17% Hispanic, 3.6% 
Asian/Pacific Islander, and .2% Native American. Of these children, 
37.9% come from low-income households, 6.3% come from homes 
whose native language is not English, and 14.8% attend schools that are 
on “School Improvement Status.” 

This research study, conducted in May 2004, surveyed K-8 ele- 
mentary and middle school building administrators in one section of one 
county in Illinois — suburban Northern Cook. Suburban Northern Cook 
County is bordered by DuPage County on the west. Take County to the 
north, the City of Chicago and Interstate 80 to the south, and Take Michi- 
gan to the east. In comparison with state totals, the racial make-up of the 
students within suburban Northern Cook County comprises fewer black 
children but more Asian/Pacific Islanders and approximately equal num- 
bers of children who come from homes where English is not spoken. 
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Within Northern Cook County, 148,000 students are enrolled within 200 
public schools. Of these 200 schools, 192 educate children in grades K-8. 
Administrators of these 192 schools, which compose 32 elementary 
school districts, were the target population for this study. 

North Cook County Illinois was chosen for the study by the 
researchers because of the need for a high response rate from a limited 
population. Limited funding for the project deterred the researchers from 
surveying all of Cook County let alone all of Illinois. Therefore, a high 
response rate from the potential participants was desired. Both researchers 
had worked as school administrators in North Cook County and felt that 
their name recognition would motivate busy school administrators to 
respond resulting in a higher response rate for the study. 

Method 

Participants. Funding limitations dictated that a sample of 102 schools 
from the total 192 K-8 buildings be sent a survey addressed to the build- 
ing administrator about the current system of teacher evaluation in the 
local school/school district and its perceived link to student performance. 
Within this sample, all thirty-two elementary school districts within North 
Cook County were represented by at least one school building. After 
ensuring that all districts were represented by one school building, the 
remaining schools were numbered and blindly selected through a rotation 
model. This was to make certain that larger school districts were repre- 
sented in proportion to their relative size while ensuring that school build- 
ings were chosen by chance rather than because of a possible special 
relationship with either researcher. Of the 102 surveys, 63 were complet- 
ed and returned resulting in a 62% return rate. 

Questionnaire. An 18-item self-administered questionnaire was devel- 
oped and tested with a focus group of school administrators who were not 
to be included in the study. Once refined, the questionnaire and proce- 
dures were approved by a university Internal Review Board (IRB) and 
mailed to the aforementioned participant sample. Item development was 
based upon leadership, school improvement, teacher evaluation, and 
human resources literature and context-specific issues. Part One of the 
questionnaire asked building administrators to provide demographic data 
about their school district and school building along with their number of 
years as an administrator (see Appendix). Additionally, on the second 
page of the questionnaire, building administrators were asked to record 
the number of teachers they evaluated that year and the average amount of 
time they spend per year on non-tenured vs. tenured teacher evaluations. 

Part Two of the questionnaire asked principals to indicate the 
tools they used for non-tenured and tenured teacher evaluation and to rate 
the effectiveness of these tools 1 through 5, with 1 as very high and 5 as 
no impact. Based on teacher evaluation literature (Danielson, 2001, 
2002), the following tools were listed: end of year summative checklist 
authored by the principal, end of year summative narrative authored by 
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the principal, pre-observation conference, observation checklist, post- 
observation conference, portfolio authored by the teacher, and other. 
Within the category “other,” space was provided for the respondent to 
describe the tool. 

Part Three consisted of three open-ended items. Participants 
were first asked to describe the perceived benefits of their current evalua- 
tion system. Another item asked participants to describe the perceived 
impediments to this current teacher evaluation system. Finally, partici- 
pants were asked to describe the activities they do, or would like to do, 
that they believe have, or would have, the greatest impact on teaching and 
learning. 

Data collection. A hybrid of Hillman’s (2000) Tailored Design Method 
and Queeney’s (1995) Survey Design Method was used to maximi z e sur- 
vey response. A cover letter, questionnaire, and addressed stamped enve- 
lope were sent to all participants. A post-card reminder was mailed 
approximately three weeks after the questionnaire. Additionally, on both 
the cover letter and the postcard, the phone numbers and email addresses 
of both researchers were provided, in case clarification was needed. 

Data analysis. The survey data were entered in Microsoft Excel 2002 edi- 
tion for analysis. Frequencies and percentages were used to describe 
closed-ended survey responses. Since participants ranged in years of 
experience, size of building, and number of non-tenured vs. tenured teach- 
ers to evaluate, baseline response expectations were not formulated. 
Instead, data were analyzed to identify any trends that might appear with- 
in these contextual categories (Maxwell, 1996). Through inductive analy- 
sis (McMillian & Schumacher, 2001) “categories and patterns emerged 
from the data gathered rather than being imposed apriori” (p. 462). Inter- 
data analysis was then used with these contextual trends to understand if 
any relations occurred between the context of the participant, the tool of 
evaluation, and the perceived effectiveness of the tool (Miles & Huber- 
man, 1994). Additionally, quantitative data were then used as a reference 
point to verify and triangulate the open-ended feedback (Denzin, 1989). 
Through data reduction, data display, conclusion creation, and triangula- 
tion, verification and trend identification of the data were achieved 
(Berkowitz, 1997). 

The data were initially analyzed and confirmed with the existing 
literature independently by each researcher in order to perform data reduc- 
tion, display, and triangulation, and conclusion creation. Only after the 
entire inductive process was completed independendy by each researcher 
did the two researchers then share their data-generated and literature-veri- 
fied themes with each other. The researchers independendy generated the 
same themadc concepts from the data for all of the results detailed in this 
paper. While this does not guarantee reliability and validity, it does pro- 
vide “dependable results” (Cuba & Lincoln, 1981, p. 146) which create a 
“rich and thick description of the context being examined and which can 
be retested by either quantitative or qualitative means to further establish 
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reliability and validity” (Merriam, 1988, p. 19). To that end, we have 
appended a copy of the survey instrument for further replication. 

Furthermore, because themes were generated inductively after 
data were collected, some data that were gathered did not prove relevant 
after the inter-data analysis. In particular, the inductive process with sub- 
sequent inter-data analysis rendered information concerning the demo- 
graphics of the school building, the number of years as administrator, and 
the number of teachers evaluated as non-explanatory themes for this data 
set. Rather the theme of non-tenured vs. tenured consistendy appeared as 
an organizing element for the data. 

Results 

Teacher Evaluation Approaches and Their Effectiveness 

School administrators report that post-observation conferences, 
pre-observation conferences, and summative narratives were the most wide- 
ly used evaluation tools for both tenured and non-tenured staff faculty mem- 
bers. Percentages equal more than 100% since most a d ministrators use a 
combination of tools for both non-tenured and tenured staff. The largest 
variation between the two faculty groups occurred within the areas of pre- 
observation conference and other. The data indicate that school administra- 
tors often will forgo pre-observation meetings with tenured faculty as well 
as provide alternative evaluation opportunities for these staff members. 
These other opportunities included the following: research action plans, 
grade level collaboration projects, and teacher leadership responsibilities 
including mentoring, coaching, and committee stewardship. 

Table 1 

Teacher Evaluation Approaches Employed 

% of teachers who used approach 
Approach Non-tenured Tenured 


Summative checklist 

42 

43 

Summative narrative 

85 

83 

Pre-observation conference 

91 

75 

Observation checklist 

43 

32 

Post-observation conference 

98 

85 

Portfolio 

25 

26 

Other 

25 

38 


School administrators were asked to rate each of the tools men- 
tioned in Table 1 on a closed matrix scale from 1-5, with 1 as very highly 
effective and 5 as not effective at all. Averages were then compiled from 
these responses (see Table 2). Rating averages clustered around the 2.5 
mark indicating a limited degree of effectiveness with the teacher evalua- 
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tion tools. 

Table 2 


Average Effectiveness Ratings of Teacher Evaluation Approaches 


Approach 

Average effectiveness rating 

Summative checklist 

2.55 

Summative narrative 

2.68 

Pre-observation conference 

2.57 

Observation checklist 

2.58 

Post-observation conference 

2.2 

Portfolio 

2.61 

Other 

2.5 


Time Required 

Table 3 details the responses by the school administrators about 
the average amount of time devoted to the annual evaluation of both indi- 
vidual non-tenured and tenured teachers. For non-tenured teachers, over 
50% of school administrators spend more than ten hours per teacher each 
year on the full evaluation process including preparation, observation, 
conferencing, and documentation. For tenured teachers, 64% of adminis- 
trators spend five hours or more per teacher on the evaluation process. 

Table 3 

Time Spent on the Evaluation Process 

% of building administrators 
who spend this amount of time on . . . 

Time spent Non-tenured faculty Tenured faculty 


Up to 2 hours 

0 

7 

2-4 hours 

6 

30 

5-7 hours 

19 

30 

8-10 hours 

19 

17 

More than 10 hours 

55 

17 


Teacher Evaluation Benefits 

As study data demonstrate, school administrators devote a consid- 
erable portion of their time to implement the district required teacher eval- 
uation process even though they generally perceive that this teacher 
evaluation process has a limited direct impact on improving an individ- 
ual’s teaching and subsequent student learning. However, the question 
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remains whether or not building level administrators perceive any other 
benefits associated with the teacher evaluation process. Administrators 
identified four areas of benefit associated with teacher evaluation, some 
listing more than one benefit. 

Goal setting. The most frequently reported benefit (31%) of teacher evalu- 
ation was its usefulness in aligning individual teacher’s personal goal set- 
ting with annual district goals. The inclusion of goal setting components in 
the teacher evaluation process helped administrators to work with faculty 
members to develop well-aligned individual annual goals that often includ- 
ed action plans. Another benefit of the goal setting process was that it con- 
tributed to richer discussions between the evaluator and teacher, 
particularly with tenured faculty, and that as a result of this discussion per- 
sonal staff development plans were often created. Others noted the value 
of goal setting in assisting non-tenured teachers to be more reflective about 
their teaching. 

Enhanced supervision. A significant percentage of respondents (26%) 
indicated that their current teacher evaluation processes, when adminis- 
tered well, had an impact on the efficacy of the supervision process. 
Most frequendy identified benefits of this enhanced supervision included: 

• Delineating specific focuses for classroom observations 
which in some instances targeted teaching deficiencies while 
providing a structure for the overall process; 

• Providing a vehicle for the development of in-depth observa- 
tion narratives which were used to set higher performance 
expectations; 

• Identifying teaching strengths and weaknesses, particularly 
with non-tenured faculty; and, 

• Providing an option to extend teacher evaluation beyond tra- 
ditional classroom observation and summative narratives into 
professional development projects. 

Enhanced communication. Another perceived positive of current teacher 
evaluation was enhanced communication. Administrators (23%) reported 
that their required plans created an effective structure for teacher/evalua- 
tor discussion. Benefits included: 

• Establishing specified times for observation and pre- and 
post- conferencing that provided for focused communication; 

• Creating a format for the sharing of expectations, school val- 
ues, and curricular issues between the evaluator and faculty 
member; 

• Developing a higher level of professional dialogue particular- 
ly with tenured teachers; and. 


56 


Planning and Changing 



Teacher Evaluation 


• Helping to create a common school-wide language related to 
teaching and learning. 

Comprehensive process. The comprehensiveness of their district evalua- 
tion plans was mentioned as a benefit by 20% of the participants. In these 
districts, administrators reported that written, fully-developed standards 
and well-defined processes, often including evaluation rubrics and struc- 
tured evaluation timelines, added substance to the overall model and led 
to more complete supervision and evaluation. In addition, some respon- 
dents noted that an important benefit of their comprehensive processes 
was that they were useful in holding faculty accountable for basic overall 
performance. Respondents listed this area of comprehensiveness separate- 
ly from other tools that might be used such as the portfolio or action 
research model. 

Impediments to Highly Effective Teacher Evaluation 

A large percentage of participants (87%) identified one or more 
impediments that they perceived impacted their ability to implement fully 
the teacher evaluation process in their schools. Three primary impedi- 
ments were reported: time, unions and school culture, and evaluation 
process constraints. These impediments were perceived by the building- 
level administrators to limit the effectiveness of their teacher evaluation 
processes. Some respondents indicated more than one impediment. 

Time. Limitations associated with time were identified by 47% of the par- 
ticipants. This response rate indicates that building-level administrators 
believe that they do not have adequate time available to devote to teacher 
evaluation particularly since their teacher evaluation processes are time 
intensive and difficult to implement given the other demands of school 
administration. Many reported that they were required to evaluate too 
many teachers each year and that the paperwork demands associated with 
their district evaluation process were very extensive. Several participants 
felt that they did not have adequate time to supervise their non-tenured fac- 
ulty who they believed needed more intensive supervision. In instances 
where school districts required the annual evaluation of all teachers, 
administrators reported that they found it necessary to shortcut parts of the 
process just to complete even the most basic elements. Finally, a lack of 
time to train administrators impeded the process and often resulted in 
inconsistent teacher evaluations within individual school districts. 

Unions and school culture. Concerns related to the impact of unions and 
the pre-dominant culture of schools, in general, were reported by 36% of 
study participants as significant impediments to effective teacher evalua- 
tion. In a number of school districts collective bargaining agreements were 
found to limit the scope and substance of teacher evaluation. A conse- 
quence of union activity reported by some administrators was the willing- 
ness of faculty members to challenge some aspect of either the evaluation 
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procedures or content of their personal evaluations by taking their concerns 
directly to the local teacher unions/associations which often then inter- 
vened in the process. As a result, administrators noted a disincentive for 
thorough, honest evaluations and an erosion of confidence in the evalua- 
tion process. 

This union role in collective bargaining, including in teacher eval- 
uation, may be more symptom than cause. Over the past few decades, both 
the role and impact of unions have grown significandy in response to the 
increased sophistication of public education and the ever-expanding politi- 
cal nature of school governance, particularly related to faculty employment 
and retention. However, as discussed in the review of the literature con- 
cerning unions and teacher evaluation, unions were relatively comfortable 
with objective check-lists of teacher performance. Further research is nec- 
essary to understand whether the erosion in confidence in the evaluation 
process is due to the more subjective nature of increasingly more complex 
teaching evaluation tools being used or a function of the political nature of 
school governance. 

In part because of these factors, the culture of public schools itself 
was viewed as an impediment. Building-level administrators freely dis- 
cussed the prominent role that the culture of public education plays partic- 
ularly within the teacher evaluation process. Administrators noted that 
teachers typically expect to receive excellent evaluations and resist evalua- 
tion methods that deviate from the status quo. Faculty willingness to 
experiment with something new in the evaluation process was often 
fraught with teacher resistance or passivity. Some administrators com- 
mented that they do not perceive school cultures embracing teacher evalu- 
ation as a tool for improvement but rather as a task which both the teacher 
and administrator are required to endure. This is contrary to the spirit of 
the new teacher evaluation tools that are considered to be best practice. 

Evaluation process constraints. Finally, 14% of the administrators noted 
that they are required to implement an evaluation process that in and of 
itself lacks effectiveness. Predominant comments received included: 

• The evaluation system is out of date and has not changed in 
decades; 

• The system is not comprehensive enough to have any real 
impact; 

• The criteria for ratings were inadequately defined and incon- 
sistently interpreted; and, 

• Although a district-wide process is in place, it does not yield 
any meaningful feedback for teachers. 

Some noted that their processes were too summative, failing to 
provide any substantial emphasis on instructional improvement, while oth- 
ers said that evaluation procedures were either too vague or too generic to 
be of any substantive use. Some administrators saw this lack of perceived 
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effectiveness of their present teacher evaluation processes as the cause for 
teacher evaluation having no real impact on individual teacher behavior. 
And yet, when the evaluation tools were designed using best practice and 
the process was more formative than summative, teacher unions became 
uncomfortable and resisted this process too. 

Improving Teaching and Learning 

If the data suggest that building-level administrators perceive 
their present teacher evaluation processes and practices having minimal 
direct impact on improving teaching and learning, what do they believe 
would directly impact teaching and learning more? Four specific recom- 
mendations emerged from the data: increase communication, expand 
staff development, increase coaching and mentoring opportunities, and 
model classroom behaviors for teachers. Combined percentages exceed 
100% as respondents often indicated more than one benefit. 

Increased communication. If building-level administrators and teachers 
could be freed from the restraints created by time, as well as from union 
and school culture constraints, 69% believe that increased opportunities 
for communication would lead to significant improvements in teaching 
and learning. These administrators said that by increasing the opportuni- 
ties for teachers to dialogue with administrators around the topics of 
teaching and learning, direct improvement could result. Although the role 
of building administrator as instructional leader is often articulated as a 
priority, the literature indicates that an evaluator’s time is consumed by 
other responsibilities not related to improving teaching and learning 
(Edmonds, 1981; McGrath, 2000). By significantly increasing specific 
communication opportunities, building-level administrators believed that 
they could make a difference in teaching and learning. Respondents most 
frequently mentioned the following suggestions: 

• Provide time for more one-on-one conversations between 
teachers and administrators, as well as between teachers, 
about teaching, learning, and the curriculum; 

• Build into the evaluation system an emphasis on faculty self- 
reflection; 

• Minimize summative and maximize formative evaluation 
processes; 

• Structure opportunities for teachers to discuss student work 
and assessment; 

• Encourage administrators to learn as much as they can about 
the day-to-day classroom activities and the instructional con- 
tent through informal visitations; 
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• Build in frequent conversations with faculty-as-a-whole 
about school supervision and goal setting particularly as they 
relate to curriculum; and 

• Expand the number of required classroom observations and 
increase the specificity of feedback. 

Staff development. Twenty-three percent of the administrators believed 
that staff development would improve teaching and learning. While the 
responses could be interpreted as another form of communication, on fur- 
ther triangulation of the data, specific themes emerged within this catego- 
ry. Respondents most frequently mentioned: 

• Tie staff development directly to student data; 

• Tie staff development directly to formal growth plans; 

• Make staff development consistent and focused on best prac- 
tice; and 

• Provide staff development time for grade-level collaboration. 

Coaching and mentoring. Seventeen percent of administrators reported 
that formal coaching and mentoring programs would also direcdy improve 
teaching and learning. Building leaders noted that these coaching and men- 
toring opportunities should provide opportunities to: 

• Model lessons; 

• Co-teach; 

• Meet as grade-level teams to create exemplary lesson plans; and 

• Meet as colleagues for “book group” learning. 

Modeling. Finally, 14% of administrators believed that when they have the 
time to actually demonstrate teaching to faculty, this modeling directly 
improves teaching and learning. Specifically, such modeling would focus 
on opportunities to: 

• Model specific lessons focused on standards-based learning; 

• Demonstrate specific instructional techniques; and 

• Co-teach with faculty. 


Limitations 

This survey was distributed to school building-level administrators 
within Suburban North Cook County in the state of Illinois. While respon- 
dent rate was high, the generalizations made can only be validly applied to 
the specific context. Transfer of findings may be possible through replica- 
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tion of this survey study to the state or the nation as a whole. Additionally, 
survey data can be limiting in that respondents could display inconsisten- 
cies between their quantitative and qualitative responses. Through continu- 
al respondent feedback and data triangulation the researchers attempted to 
clarify these possible respondent discrepancies. (Denzin, 1989; Miles & 
Huberman, 1994.) However, caution must be exercised when drawing con- 
clusions from such data. 


Discussion 

This study sought to understand building administrators’ percep- 
tions concerning the effectiveness of the teacher evaluation tools that 
school districts employ. School leaders, policy makers, board members, 
teacher union leaders, and classroom teachers may find the results useful in 
their quest for building evaluation systems that truly improve teaching and 
learning. 

The data illustrate, first, that school administrators believe that 
evaluation is beneficial within the areas of goal setting and enhanced 
supervision and communication; and, second, that teacher evaluation sys- 
tems have additional potential to benefit the teaching-learning process. 
Furthermore, when the system is comprehensive, the evaluation process 
can provide a focus and format for professional dialogue and the creation 
of a common school-wide language related to teaching and learning. These 
results are consistent with the current literature on effective teacher evalu- 
ation (Danielson, 2002; Schmoker, 2001). 

In addition, the data strongly suggest that time, unions and school 
culture, as well as actual system constraints often negate many of the ben- 
efits of the teacher evaluation process. Respondents overwhelming (more 
than 50%) spend an enormous amount of time (more than 10 hours per 
teacher each year) on the evaluation process with non-tenured faculty. With 
such a large expenditure of time, it is understandable that completing the 
process could take precedence over meaningful conversations that could 
directly affect teaching and learning. This is contrary to what best practice 
in teacher evaluation should be. When understanding the potential benefits 
of teacher evaluation, a reexamination of what type, how much, and for 
whom, possibly along non-tenured/tenured lines, is necessary if we want 
best practices in teacher evaluation to be conducted in a meaningful, mind- 
ful manner. 

Additionally, the complexity of public education and the growing 
political nature of school governance, particularly related to teacher unions 
and school culture, need to be examined further. Respondent data suggest 
that these factors contribute to a culture within schools that supports the 
status quo and squashes risk-taking and innovation. Additionally, system 
constraints play a part in impeding the promise of teacher evaluation. Fur- 
ther study needs to be conducted to understand the relationships among 
time, unions, politics, school culture, and system restraints to see if it is 
possible to create evaluation systems that are embraced by unions, benefit 
teaching and learning, and are not so cumbersome that school administra- 
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tors drown from the workload. 

Finally, school administrators do believe they can make a differ- 
ence in teaching and student learning. While noting the impediments, 
especially time, school administrators believe that, through increased 
communication opportunities, data-driven targeted staff development, 
peer coaching and mentoring, as well as principal demonstration teaching, 
they can improve instruction in the classroom. Many of these suggestions 
are supported in the current literature on school improvement (Sawyer, 
2001; Senge, et al., 2000; Stigler, 1999). The concept of principal demon- 
stration teaching suggests an even more active role for the school admin- 
istrator as an instructional leader. However, if the issue of time is not 
addressed, the school administrator will not be able to take advantage of 
this possible school improvement strategy. The question is how to provide 
the means within teacher evaluation, as well as the time, for these types of 
meaningful opportunities to occur. 

Conclusion 

Teacher evaluation, when conducted appropriately, has the poten- 
tial to improve teaching and learning. However, our research data suggest 
that, in our quest for a more comprehensive teacher evaluation system that 
depicts the true nature of teaching and learning, we may have created a 
monster. Our data indicate that principals believe that the current teacher 
evaluation systems are inordinately time intensive and preclude many 
other opportunities for school building leaders to work with faculty to 
improve classroom instruction. Additionally, our research data explain 
that principals perceive unions as not trusting the more complex, subjec- 
tive teacher evaluation methods that are currently considered best prac- 
tice. Therefore, further study must be done to understand the real potential 
of alternatives, especially within the areas of peer coaching and mentor- 
ing, that provide avenues for shared leadership, including the concept of 
principal as fellow and model teacher. Additionally, further research needs 
to be done to ascertain the strategies necessary to promote shared respon- 
sibility and trust between management and unions if the evaluation 
process is going to be a vehicle for school improvement and positive 
change. 
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Appendix 

Teacher Evaluation Survey 
© Kersten & Israel 2005 


Demographic Data: 

Your Position: Principal Asst. Principal Dept. Chair 

Experience: Total years in school administration 

Your Building: Elementary 

Middle School/Junior High 

High School 

District: Elementary High School Unit 

District Enrollment: Eess than 1,000 

1,000-3,999 

4,000 or over 

Teacher Evaluation Tools & Effectiveness: 


Please check all that are used. Next to each tool used, please note its 
effect on improving teaching and learning on a 1-5 Effectiveness Rating 
(ER) scale with 1 as very high and 5 as no impact. 


Tool 

Non- 

Tenured 

Effectiveness 

Rating 

Tenured 

Effectiveness 

Rating 

End of the Year 

Summative 

Checklist 





End of the Year 

Summative 

Narrative 





Pre-Observation 

Conference 





Observation 

Checklist 





Post-Observation 

Conference 





Portfolio 





Other * 






* Please describe 
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Additional Questions: 

How many certified faculty members did you evaluate during the 
2003-04 school year? 

On the average, how much time per year do you spend completing all 
aspects (preparation, observation process, meeting, write up, documenta- 
tion, etc.) for evaluating a typical non-tenured teacher? 

Up to 2 hours 8-10 hours 

2-4 hours Over 10 hours 

5-7 hours 

On the average, how much time per year do you spend completing all 
aspects (preparation, observation process, meeting, write up, documenta- 
tion, etc.) for evaluating a typical tenured teacher? 

Up to 2 hours 8-10 hours 

2-4 hours Over 10 hours 

5-7 hours 

What do you see as the primary benefit of your district’s present teacher 
evaluation system? 


What do you see as the most significant impediment to teacher evalua- 
tion? 


What do you do, or would you do, to provide the greatest impact on 
teaching and learning? 


Thank you for your assistance. 
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